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PROTOCOL FOR A REMOTE CONTROL DEVICE 
TO ENABLE CONTROL OF NETWORK ATTACHED DEVICES 

Technical Field 

5 

The present invention relates generally to the control of devices attached to a 
network, and more particularly to a protocol facilitating the control of multiple 
network attached devices by a remote control device. 

10 Background of the Invention 

Consumer electronic devices are often controlled by remote controls. 
Typically these remote controls or "remotes" are handheld devices having a series of 
buttons. Some remotes have a limited LED display and, in the case of "all in one" or 
1 5 "multi-remotes", control more than one device. Devices which are traditionally 

controlled by such remotes include televisions, VCR's, stereo receivers, CD players 
and other similar devices. 

The remotes control the devices by sending the device a command code that is 
20 encoded in an infrared ( IR ) signal. The command code causes the device to execute 
a particular operation. For instance, the remote may send an "off command to the 
TV which causes the TV to turn off. Each device has its own unique set of commands 
and corresponding command codes. The remote has to be manually programmed for 
each device it seeks to control. For example, to program a device, a user may be 
25 instructed to enter a device code ( such as 247 ) by pressing numbers on the keypad of 
the remote. For a second device, the user might be instructed instead to enter the 
device code of 249. The device code serves as an index into a code table which has 
been pre-programmed into the remote. The code table identifies the proper command 
codes for the associated device. A user can then use the remote to control the device 
30 whose codes the remote has identified. 

This current approach has some major drawbacks. First, the approach does 
not readily accommodate new devices. The remote does not have access to command 
codes for the new devices because the pre-programmed tables of codes pre-date the 
35 new device's date of creation and are structurally fixed. Additionally, this approach 
requires the manual configuring of the remote by a user who may or may not perform 
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the procedure correctly. An additional problem is that, the majority of remotes that 
are in use today are "line of sight" remotes that require close proximity with no 
obstacles between the remote and the device. The IR signals must have an 
unobstructed path from transmitter to receiver in order to be effective. Yet another 
5 problem is that the types of devices capable of being controlled by a remote are 

restricted for the most part to consumer electronic devices for which the remotes are 
programmed in advance. 

Summary of the Invention 

10 

The present invention addresses the difficulties of controlling new devices 
which have been added to a network. A network protocol, hereafter the NetCTL 
protocol, enables a remote control device to dynamically learn the command codes of 
a newly network attached device if the new device is executing the protocol. The 

1 5 intervention of a system administrator is not necessary since the dynamic learning 
process happens automatically when the new device is attached to the network. 
Because the protocol allows the remote control device to learn the codes dynamically, 
there is no need to consult previously written tables of commands which can omit the 
codes for newly invented devices. A user of the remote control device which has 

20 "learned" the codes ( i.e. acquired the codes ) for a network attached device is able to 
control that device regardless of the device's physical location. 

In accordance with one aspect of the present invention, a method is practiced 
whereby the protocol enables a remote control device having a network interface to 

25 dynamically learn the command codes of a device attached to the network. The 
network attached devices whose commands are capable of being learned by the 
remote control device can take many forms such as kitchen appliances, stereo 
equipment, computer equipment, etc. Any network attached device that uses 
command codes and is equipped with the protocol can be located by the remote 

30 control device. Once the remote control device has learned the command codes, a 
user of the remote control device can use the remote control device to control the 
network attached device by sending the learned command codes to that network 
attached device. An example of the use of the protocol would have a user with access 
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to a remote control device in a house's bedroom sending command codes to a stove in 
the kitchen and a stereo in the living room. The protocol enables the remote control 
device to control types of devices attached to the network which traditionally have not 
operated via remote control. 

5 

In accordance with another aspect of the current invention, the network 
environment is in a motor vehicle and a method is practiced whereby the protocol 
enables a remote control device having a network interface to dynamically learn the 
command codes of a device attached to the automobile network. The network 

1 0 attached devices themselves can take many forms. Any network attached device 

connected to the automobile network that uses command codes and is equipped with 
the protocol can be located by the remote control device. Once the remote control 
device has "learned" the command codes, a user can use the remote control device to 
control the network attached device by sending command codes to that network 

1 5 attached device. 

Brief Description of the Drawings 

Figure 1 is a block diagram showing an illustrative embodiment of the present 
20 invention; 

Figure 2 is a block diagram showing an alternative embodiment of the present 
invention which includes a network that is located in a car; 

Figure 3 is a block diagram depicting a remote control device used to execute 
the NetCTL protocol; 

25 Figure 4A is a block diagram illustrating the sequence of messages occurring 

in one aspect of the illustrated embodiment that does not use a Directory Agent of the 
Service Location Protocol; 

Figure 4B is a block diagram illustrating the sequence of messages occurring 
in an alternative aspect of the illustrated embodiment that does use a Directory Agent 
30 of the Service Location Protocol; 

Figure 5 is a block diagram showing the frame format of the header for client 
side messages used in the illustrated embodiment; 
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Figure 6A is a flow chart of the sequence of messages in the illustrative 
embodiment's Hello request and response; 

Figure 6B is a block diagram showing the frame format used in the body of 
the Hello Request and the Hello Response of Figure 6; 
5 Figure 7 A is a flow chart of the sequence of messages in the illustrative 

embodiment's List Commands request and response; 

Figure 7B is a block diagram showing the frame format used in the body of 
the List Commands Request and the List Commands Response of Figure 7; 

Figure 8A is a flow chart of the sequence of messages in the illustrative 
1 0 embodiment's Do Command request and response; 

Figure 8B is a block diagram showing the frame format used in the body of 
the Do Request and the Do Response of Figure 8; 

Figure 9A is a flow chart of the sequence of messages in the illustrative 
embodiment's Goodbye Command request and response; 
1 5 Figure 9B is a block diagram showing the frame format used in the body of 

the Goodbye Request and the Goodbye Response of Figure 9; 

Figure 1 OA is a flow chart of the sequence of messages in the illustrative 
embodiment's Get Image Command request and response; 

Figure 1 OB is a block diagram showing the frame format used in the body of 
20 the Get Image Request and the Get Image Response of Figure 10; 

Figure 1 1 A is a flow chart of the sequence of messages in the illustrative 
embodiment's Get Text Command request and response; 

Figure 1 IB is a block diagram showing the frame format used in the body of 
the Get Text Request and the Get Text Response of Figure 11; 
25 Figure 12A is a flow chart of the sequence of messages in the illustrative 

embodiment's Get Layout Help Command request and response; 

Figure 12B is a block diagram showing the frame format used in the body of 
the Get Layout Help Request and the Get Layout Help Response of Figure 12. 
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Detailed Description of the Invention 

The illustrative embodiment of the present invention employs a 
5 protocol ( i.e. the NetCTL protocol ) that facilitates a remote control device locating 
other network attached devices. The protocol also enables the remote control device 
to dynamically learn command codes for network attached devices and then use those 
command codes to control the network attached devices. The set of device types that 
can be controlled by the remote control device is not statically fixed and is limited 
1 0 only by the number of devices on the network executing the protocol and hardware 
limitations of the remote control device. 

The protocol is designed to be used in a network, such as a computer network 
that supports the TCP/IP protocol suite. Because protocol communications are carried 

15 over the network, there is no need for the remote control device to be in physical 
proximity or "line of sight" with the controlled device. In fact, the remote control 
device's network interface can be either a physical interface or a wireless interface. 
Moreover, the types of devices that may be controlled by the remote control device 
includes devices that are not typically controlled by an Infrared remote control 

20 device. 

Figure 1 depicts an environment suitable for practicing the illustrative 
embodiment of the present invention. The environment includes a network 2 to which 
devices 4, 6, 8, 10 are interfaced. The devices include a remote control device 4 that 

25 supports the NetCTL protocol. The devices also include network attached devices 6 
and 8 that do not support the NetCTL protocol ( and network attached device 10 that 
supports the NetCTL protocol ). The remote control device 4 may control all of the 
attached network devices 6, 8 and 1 0, even the devices 6 and 8 that do not support the 
protocol. It is presumed that the remote control device 4 is already aware of the 

30 network attached devices 6 and 8 but is not yet aware of network attached device 10 
in the depiction of Figure 1 . 
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Those skilled in the art will recognize that the components shown in Figure 1 
are intended for illustration purposes only and are in no way meant to be limiting. 
The present invention may be practiced on networks having different topologies and 
possessing different network devices. The network may be an Internet Protocol (IP) 
5 based network capable of sending and routing packets over the Internet. If the 
network is an IP based network, both the remote control device and any network 
attached devices executing the NetCTL protocol will also use the Service Location 
Protocol ( SLP ) as part of the device identification/registration process. 

1 0 The Service Location Protocol ( SLP ) is a protocol established by the Internet 

Engineering Task Force ( IETF ) that simplifies the discovery of network resources. 
The protocol utilizes the concept of User Agents, Service Agents and Directory 
Agents. Applications running on a computer are represented by User Agents which 
understand the service and resource needs of the application. In the case of the 

15 present invention, the remote control device is represented by a User Agent. Each 
network device is represented by a Service Agent. Some networks have Directory 
Agents. The Service Agent sends out a multicast request for any Directory Agents on 
the network to make contact. If any Directory Agents respond, the Service Agent 
sends a registration unicast to each responding Directory Agent. The registration 

20 unicast includes the type of device the Service Agent is representing, the device's 

attributes, and the device's Uniform Resource Locator ( URL ) address. An attribute 
is a characteristic that can be used to distinguish one device from another. For 
example an attribute for a printer is color capability. Another attribute for the printer 
is its location. When a User Agent needs a particular service, it sends out a service 

25 request which includes both the type of service and attributes desired. If the network 
possesses a Directory Agent, the Directory Agent responds with a list of eligible 
devices and the devices Uniform Resource Locator ( URL ) address. If there is no 
Directory Agent on the network, the User Agent multicasts its service request on the 
network and the Service Agents for devices whose attributes match those requested 

30 respond directly to the User Agent. 

In one embodiment of the present invention, the network is an Internet 
Protocol ( IP ) based network and the Service Location Protocol ( SLP ) is utilized to 
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locate and identify available network attached devices, such as the network attached 
device 10. The NetCTL protocol utilizes the SLP in one of two ways depending on 
the configuration of the network 2. Upon being initially attached to the network, the 
Service Agent for a device executing the NetCTL protocol 10 multicasts a request for 
5 any available Directory Agents to contact the Service Agent. The Service Agent then 
unicasts a "registration" message to each responding Directory Agent. The 
registration message includes a text string identifying the name of the network 
attached device 10, the device's attributes, and the URL address giving the device's 
location on the network 2. The Directory Agent will subsequently forward this 

1 0 information to the remote control device 4 when the User Agent for the remote 

control device sends out a multicast request for a list of available network devices. If 
the network 2 does not have a Directory Agent, the User Agent for the remote control 
device 4 sends a multicast request out on the network directing Service Agents which 
represent devices which possess certain attributes to contact the User Agent. 

1 5 Regardless of which method is used, once the remote control device 4 receives the 
information for a device it wishes to contact, it can do so directly by sending 
messages to the device's URL address. 

Figure 2 depicts an alternative embodiment of the present invention where the 
20 remote control device 4 is used in an automobile. The environment shown in Figure 2 
includes a car network 12 to which a Seat Positioning Control Device 16, a Climate 
Control Device 1 8 ( heating and air conditioning ), a CD player 20 and a Global 
Positioning Device 22 ( used to provide mapping operations for the driver ) are 
attached. A car stereo 24 and a cellular phone 26 are also connected to the network. 
25 The remote control device is capable of controlling all of the components 1 6, 1 8, 20, 
22, 24, and 26 by sending communications on the internal car network 12. 

The illustrative embodiment facilitates multiple network attached devices 1 0 
being identified by the remote control device 4. After identification of the network 
30 attached device 10, the remote control device 4 dynamically learns the command 
codes of the identified network attached device through a sequence of protocol 
defined request and response messages. Once the remote control device 4 has 
received the codes for the network attached device 10, a user of the remote control 
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device is able to select a device from among those devices that have been identified, 
and issue commands to that network attached device. 

Figure 3 depicts in more detail, an example of the remote control device 4. 
5 The remote control device 4 includes, a touch screen display surface 28. A graphical 
user interface ( GUI ) is shown on the touch screen display surface 28. The GUI 
includes numbers 1-10 ( identified by reference number 30 in the figures ) that may be 
depressed by a user to make a selection. The GUI also depicts the names 3 1 of the 
network attached devices that can be controlled by the remote control device 4. Each 

10 network attached device name 3 1 appearing on the display surface 28 corresponds to 
a graphical user interface simulating a button 30. For example, "Seat" corresponds 
with button "1". A user selects a particular device by touching the appropriate button 
and a request is sent to the selected device. The remote control device 4 includes a 
TINI board 36 ( provided by Dallas Semiconductor, Inc. ) with a serial port 32 and a 

1 5 network interface 34. The TINI board 36 contains a processor for executing 

instructions. The remote control device 4 also includes a 1 wire bus 42 and a plurality 
of switches 40 and ID chips 38 corresponding to the number of simulated buttons. 
Each "button" has 1 switch 40 and identity chip 38 assigned to it. The depression of a 
button closes the corresponding switch 40 which activates the identity chip 38. The 

20 identity chip 38 sends a signal bearing its ID to the TINI 36 which then sends a 

NetCTL protocol request to the selected device by way of the network interface 34. 

The images depicted on the touch screen display surface 28 will vary 
according to the stage of communication between the electronic remote control device 
25 4 and network attached devices. Thus after the user selects one of the network 

attached devices, a new screen may be shown to provide the user with appropriate 
choices. 

A practitioner of the art will recognize that the physical composition of the 
30 remote control device 4 can take many different forms. For example the display 
surface can be a standard LCD display or a regular computer monitor screen rather 
than a touch screen and the simulated buttons may be replaced by mouse buttons or 
keyboard keys rather than through the use of a touch screen. Alternatively, the 
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buttons can be physical buttons next to the display surface which a user would 
manually depress. Additional embodiments of the invention are also possible. 
However, regardless of the form of the physical makeup of the buttons 30 on the 
remote control device 4 , the protocol functions identically in handling 
5 communications with the network attached devices. 

When the user of the remote control device 4 selects the device that they are 
interested in by pressing/clicking on the button 30 associated with the name of a 
device on the network, the button being either physical or virtual, a request for the 

10 operational command codes for that device is sent over to the network attached device 
10. The NetCTL protocol includes several formats for replies to the command 
request. The format that is used is dictated by the capabilities of both the remote 
control device 4 and the network attached device 10. In the case of a first format, the 
network attached device replies to the request with the command codes for the device 

1 5 accompanied by a text string. A second format enables the network attached device 
1 0 to return its command codes accompanied by a graphic image. A format enables 
the selected device to return its command codes accompanied by a text string and 
graphic image combination to the remote control device 4. 

20 By way of example, three allowable formats, which are described in more 

detail below are summarized in this chart for hypothetical responses from a selected 
VCR: 

First Format 



code 
000 
001 
010 
011 
100 
101 



Accompanying Text String 
"Stop" 
"Play" 
"Fast Forward" 



"Reverse" 
"Record" 
"Pause" 



Second 
Format 



code 
000 
001 
010 



Accompanying graphic 

□ 



C3CZ> 
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011 




a 


100 




o 


101 






Third Format 






code 


□ 


text and graphic 


000 


"Stop" 


001 


rz> 


"Play" 


010 


o cz> 


"Fast Forward" 


011 


a 


"Reverse" 


100 


O 


"Record" 


101 




"Pause" 



In the event the first format is used, the text string is shown on the touch 
screen display surface 28. In the event the second format is used, the graphical image 
5 is shown on the touch screen display surface 28. In the event the third format is used, 
both the text string and the graphical image are shown on the display surface 28. If a 
format is requested by the remote control device 4 that the network attached device 10 
cannot satisfy ( i.e. a request to a network attached device to send an image graphic 
when the network attached device supports only text messages, or a request for a 

1 0 JPEG type image when the network attached device supports only GIF images ), an 
error message is returned to the remote control device, and the remote control device 
subsequently requests another format that both devices can utilize. Each command 
listed on the touch screen display surface 28 is associated with one of the buttons 30 
of the remote control device 4. The user clicks on a button 30 associated with an 

15 operational command, and the command code is sent back to the network attached 
device. Upon receiving the command code, the network attached device 1 0 attempts 
to execute the command and returns an acknowledgment of success or an error 
message to the remote control device 4. 

20 Figure 4A depicts the exchange of messages between a remote control device 

4 and a network attached device 10, a VCR. These two devices 4 and 10 are attached 
to a network which does not have a SLP Directory Agent. Since there is no Directory 
Agent, the multicast registration request sent out by the Service Agent for the VCR 
goes unanswered. With no Directory Agent, the Service Agent for the VCR 10 will 

25 listen to the network for service requests matching the services and attributes of the 
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VCR. The User Agent for the remote control device 4 sends out a multicast request 
for Directory Agents. Upon getting no response, the User Agent will multicast a 
service request for the type of service the remote requires 45. The Service Agent for 
each device matching the requested service will unicast a response 46 back to the 
5 remote control device 4. Subsequently, the user of the remote control device 4 sees a 
list displayed on the display surface 28 of all of the available identified devices. In 
one embodiment of the present invention, the list includes the text string name that 
accompanied the URL of the network attached device in the registration multicast 45. 
The user of the remote control device 4 selects the VCR 10 by depressing the 

1 0 button ( physical or virtual ) 30 that corresponds to the VCR 1 0. The remote control 
device 4 sends a request 47 to the VCR 1 0 for the command codes of the VCR. Upon 
receipt of the command request, the VCR 1 0 sends a copy of its command codes 49 to 
the remote control device 4 via the network 2. The remote control device 4 displays 
the available commands on its display surface 28, and the user selects a command by 

1 5 depressing the associated button 30. The selection results in a command code 5 1 

being sent to the VCR 10. The VCR 10 attempts to perform the command and sends 
either an acknowledgement or an error message 53 to the remote control device 4. 
Upon receipt of the acknowledgement or error message 53 , the remote control device 
4 waits for further selections by the user. 

20 

Figure 4B depicts the sequence of messages exchanged between a network 
attached device 1 0, a VCR, and a remote control device 4 that are utilizing the present 
invention on an IP based network which includes an SLP Directory Agent 58 to 
process SLP device registrations. The VCR 1 0, sends out a registration multicast 

25 request 48, utilizing the SLP protocol, to advertise its presence on the network. The 
registration multicast 45 is received by the Directory Agent 58 for the 
network 2 ( Figure 1 ). The Directory Agent 58 stores all of the registrations of the 
different network attached devices 10 as they occur. The User Agent for the remote 
control device 4 multicasts a request to identify available Directory Agents. The 

30 individual Directory Agents respond with identifying information. Subsequently, a 
user of the remote control device 4 selects an attribute descriptive of the type of 
devices the user wishes to control. Such an attribute may be for example, "video". 
The User Agent SLP service request 61 is forwarded to a Directory Agent 58 for 
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processing. The SLP Directory Agent 58 responds to the request 61 by sending a list 
of all the devices matching the attribute class 63 back to the remote control device 4. 
The list matching the video attribute might be for instance "TV" and "VCR". The 
text string names are accompanied by the URLs of network attached devices. The 
5 user of the remote control device 4 selects a device to control from the list of those 
displayed 31, in this case the VCR 10. A request for command codes 47 is sent to the 
VCR 10. Upon receipt of the command code request 47, the VCR 10 sends a copy of 
its command codes 49 to the remote control device 4 via the network 2. The remote 
control device 4 displays the available commands on its display surface 28 and the 

10 user selects one by depressing a button 30. The selection sends the selected command 
code 51 to the VCR 10. The VCR 10 attempts to perform the command and then 
sends either an acknowledgement of successful operation performance or an error 
message 53 to the remote control device 4. Upon receipt of the acknowledgement or 
error message 53, the remote control device 4 waits for further selections by the user. 

1 5 Those skilled in the art will recognize that there can be countless sequences of 

different message exchanges within the scope of the present invention and the above 
examples are offered only for the purpose of illustration and are not meant to be a 
restrictive list of the possible exchanges. 

20 The present invention dictates the form of the conversation between the 

remote control device 4 and the network attached devices 10 executing the protocol. 
The protocol works on a request-response model, where the remote control device 4 
executes the client side of the protocol and initiates the requests, and the network 
attached device 10 executes the server side of the protocol and initiates the responses. 

25 The format of the most common exchanges is outlined and described in detail below: 

Client Side of NetCTL Protocol Server Side of NetCTL Protocol 
Remote control device Network Attached Device 

30 Hello(Remote ID) 

<- ACK, Session Key(Key),Top Menu Code 
List Commands(Key, Menu Code) -> 
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4- ACK, List of Command Codes w/Text 



Do Command(Key, Cmd Code) -> 

<- ACK,Status String, Prompt,New Menu Code 

5 

Goodbye(Key) -> 

<r ACK 

Utility Functions 

Get Image(Key, Cmd Code, Pref Type) -> 
10 <- ACK, type, Image Bits, GridBag Info 

Get Text(Key, Cmd Code) -> 

ACK, Text 

15 Get Layout Help(Key, Menu Code) -> 

<r ACK, Grid Layout Info 

The illustrative embodiment of the present invention uses a frame format for 
messages between the remote control device 4 and the network attached device 1 0. 

20 Figure 5 depicts the format of the message header 74 used in the illustrative 

embodiment for all of the remote control device's requests. The header 74 is 4 bytes 
in length and includes a 1 byte version code field 76 set to the version number of the 
protocol, a 1 byte Operation Code ( opcode ) field 78 set to the number representing 
the operation currently being performed, and a 2 byte Session ID field 80 set to the 

25 identifier number established for messages between the remote control device and the 
network attached device during the initial contact between the two devices. The 
Session ID field 80 is set to 0 if the request is the initial "Hello" request of the present 
invention. Those skilled in the art will recognize that the size of the fields in the 
frame format may be adjusted in different versions of the protocol without departing 

30 from the scope of the present invention. 

Once a user of the remote control device 4 indicates a desire to control a 
registered network attached device 10 by depressing the appropriate button 30, the 
remote control device attempts to make contact with the selected network attached 
35 device as depicted in Figure 6A. Contact is initiated in the illustrative embodiment by 
the electronic remote control 4 device sending a "Hello" request ( step 84 ) to the 
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selected network attached device 10. The "Hello" request ( step 84 ) contains an ID 
for the remote control device 4 so that the selected network attached device 1 0 can 
respond directly to the remote control device. The network attached device 1 0 sends 
a response ( step 88 ) if available, which includes an acknowledgement, a Session Key 
5 and the top level menu code to the remote control device 4. The session key is 

included in any future messages between the two devices. The Top Level Menu Code 
is included to allow the remote control device 4 to access the menu of command 
codes of the network attached device 10. 

1 0 The frame format used by the remote control device 4 and the network 

attached device 10 in the "Hello" request and response is depicted in 
Figure 6B. The header 90 used in the "Hello" request includes the protocol version 
number 92, the "Hello" operation code as defined in the protocol 94, and the number 
"0" in the Session ID field 96 since a message session with the network attached 

1 5 device 1 0 has not been established. The body of the message 98 includes the 

electronic remote control ID in the a two byte field 100. The "Hello" response format 
includes its own header 102 which includes an Acknowledgement field 104, the 
"Hello" response opcode 106, and a session ID 108 established by the network 
attached device which serves as a reference number for further messages between the 

20 remote control device 4 and the network attached device 1 0. The body of the 

response message 110 includes an acknowledgement field 1 12, the Hello Response 
Opcode field 114 and a Top Level Menu Code field 116. The Top Level Menu Code 
116 identifies the menu holding the list of commands for the selected network 
attached device 10. 

25 

Figure 7 A depicts the steps by which the remote control device 4 requests and 
receives the network attached device's commands and command codes. The remote 
control device 4 sends a List Commands request ( step 120 ) to the network attached 
device 10. The List Commands request ( step 120 ) includes the Top Level Menu 
30 Code the remote control device 4 had previously received from the network attached 
device 10. The network attached device 10 sends a response ( step 124 ), which 
includes an acknowledgement , a list of command codes and a list of text strings 
representing the names of the available commands, to the remote control device 4. 
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The frame format used by the illustrative embodiment in the List Commands 
request and response is depicted in Figure 7B. The List Commands request header 
126 includes fields for the protocol version number 128, the List Commands opcode 
5 130, and the session ID 132 assigned by the network attached device 10 in its 

response to the "Hello" request. The message body 1 34 includes the Top Level Menu 
code 136 of the network attached device 10. The List Commands response header 
138 includes separate fields for the protocol version 140, the List Commands 
Response opcode 142, and the Session ID 144. The body of the List Commands 

10 response message 146 includes separate fields for the Acknowledgement 148, the 

Command Count 150 indicating the number of commands being sent, and three fields 
for each command, the actual command 152, the length of text string field 154 
indicating the length of the following field, and the text string field 1 56 holding the 
actual name of the command. The three fields are repeated from 1 to n times, with n 

1 5 being the number of commands sent and equal to the number in the Command Count 
field 150. The text strings representing the names of device commands are displayed 
on the remote control device 4 display surface 28. 

Figure 8A depicts the steps by which the remote control device 4 of the 
20 illustrative embodiment requests the network attached device 10 perform a certain 

operation. The remote control device 4 sends a Do request ( step 160 ) to the network 
attached device 10. The Do request ( step 160 ) includes the Session ID and one of 
the network attached device's command codes which the remote control device 4 
previously received in the network attached device's List Command response 124. 
25 The network attached device's response ( step 1 64 ) includes an acknowledgement 
field and may include fields for the status of the network attached device 10 if the 
network attached device is configured to update its status upon request, and for a 
prompt message to the user if the operation requires it. The network attached device's 
response ( step 164 ) also includes a new menu code for the network attached device 
30 10, which identifies the next menu to present to the user. 

The frame format used by the illustrative embodiment in the Do Command 
request and response is depicted in Figure 8B. The Do Command request header 166 
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includes fields for the protocol version number 1 68, the Do Commands Opcode 1 70, 
and the Session ID 172. The message body of the Do command 174 includes a 
command code for the network attached device 10. The Do response header 178 
includes the protocol version header 180, the Do command response code 182 and the 
5 Session ID 184. The message body 186 includes an acknowledgement field 188, and 
a status length field 190 which indicates the length of the following status field 192. 
The status field contains bits describing the condition of the network attached device 
10. The message body 186 also includes a prompt length field 194 which indicates 
the length of the following Prompt field 196. Some operations require further input 

1 0 from the user of the remote control device 4, and the prompt field is used to send a 
text message back to the user from the network attached device 10. The Do response 
message format also includes a new menu code 198 which provides a different menu 
for the network attached device 1 0. Those skilled in the art will recognize that both 
the status length field 190 and the prompt length field 194 may in some circumstances 

15 be set to 0 and the corresponding Status 192 and Prompt 196 fields may be empty. 
The Status field will be empty if the network attached device 1 0 does not provide 
updated device information to the remote control device 4. The Prompt field 196 will 
be empty if the network attached device 10 is able to complete the operation requested 
in the Do request 1 60 without further information from the user of the remote 

20 electronic control device 4. 

Figure 9A depicts the steps by which the remote control device 4 of the 
illustrative embodiment requests the network attached device 10 terminate the 
message session. The remote control device 4 sends a Goodbye request ( step 202 ) to 
25 the network attached device 10. The Goodbye request ( step 202 ) includes the 
Session ID. The network attached device's response ( step 206 ) includes an 
acknowledgement. 

The frame format used by the illustrative embodiment in the Goodbye 
30 Command request and response is depicted in Figure 9B. The Goodbye Command 
request header 210 includes fields for the protocol version number 212, the Goodbye 
Commands Opcode 214, and the Session ID 216. The message body of the Goodbye 
command 218 is empty. The Goodbye response header 220 includes the protocol 
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version field 222, the Goodbye Command response code field 224 and the Session ID 
field 226. The message body 228 includes an acknowledgement field 230. 

The illustrative embodiment also includes utility functions that allow 
5 the remote control device 4 to obtain additional information about a device's preferred 
control pad layout and additional button image information. If the user of the remote 
control device 4 wishes to have images to display instead of text, the remote control 
device can query the network attached device 10 for them directly by sending the Get 
Image opcode. Figure 10A depicts the steps by which the remote control device 4 

10 requests the network attached device 10 send image data. The remote control device 
4 sends a Get Image request ( step 232 ) to the network attached device 10. The Get 
Image request ( step 232 ) includes the Session ID, the Command Code for providing 
the data , and a Preference Type listing the particular type of image requested 
(i.e.: JPEG, GIF , BMP, etc.). The network attached device's response ( step 234 ) 

1 5 includes an acknowledgement or error message, an indication of the type of image 
being sent, the image bits themselves, and miscellaneous information associated with 
the image). 

The frame format used by the illustrative embodiment in the Get Image 
20 Command request and response is depicted in Figure 10B. The Get Image Command 
request header 236 includes fields for the protocol version number 238, the Get Image 
Commands Opcode 240, and the Session ID 242. The message body of the Get 
Image command 244 includes fields for a command code 246, and a preference type 
248. The Get Image response header 250 includes fields for the protocol version 
25 header 252, the Get Image Command response code 254 and the Session ID 256. The 
message body 258 includes fields for an acknowledgement 260, type ( JPEG, GIF, 
BMP, etc. ) 262, image size 264, listing the image size in bytes, image bits 266, the 
image bits themselves, and a miscellaneous image information field 268. 

30 Figure 1 1 A depicts the steps by which the remote control device 4 requests the 

network attached device 1 0 send text data. The remote control device 4 sends a Get 
Text request ( step 270 ) to the network attached device 10. The Get Text request 
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( step 270 ) includes the Session ID and the appropriate Command Code. The 
network attached device's response ( step 272) includes an acknowledgement and the 
requested text. 

5 The frame format used by the illustrative embodiment in the Get Text 

Command request and response is depicted in Figure 1 IB. The Get Text Command 
request header 274 includes fields for the protocol version number 276, the Get Text 
Commands Opcode 278, and the Session ID 280. The message body of the Get Text 
command 282 includes a field for the appropriate command code 284. The Get Text 
10 response header 286 includes fields for the protocol version header 288, the Get Text 
Command response code 290 and the Session ID 292. The message body 294 
includes fields for an acknowledgement 296, text length 298, which indicates the 
length of the upcoming text field 300, which holds the actual text bits. 

15 Figure 12A depicts the steps by which the remote control device 4 requests the 

network attached device 10 send grid layout information for the display surface 28. 
The remote control device 4 sends a Get Layout Help request ( step 302 ) to the 
network attached device 10. The Get Layout Help request ( step 304 ) includes the 
Session ID and the appropriate Menu Code. The network attached device's response 

20 ( step 304) includes an acknowledgement and the grid layout information. 

The frame format used by the illustrative embodiment in the Get Layout Help 
Command request and response is depicted in Figure 12B. The Get Layout Help 
Command request header 306 includes fields for the protocol version number 308, the 

25 Get Layout Help Command Opcode 310, and the Session ID 3 12. The message body 
of the Get Layout Help command 314 includes a field for the menu code 3 1 6 for the 
commands for which the layout help is sought. The Get Layout Help response header 
318 includes fields for the protocol version header 320, the Get Layout Help 
Command response code 322 and the Session ID 324. The message body 326 

30 includes fields for an acknowledgement 328, grid layout information size 330, which 
indicates the length of the upcoming grid layout information field 332, which holds 
the actual grid layout information. The remote control device 4 uses this information 
to arrange the information shown on its display surface 28. 
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It will thus be seen that the invention efficiently attains the objects made 
apparent from the preceding description. Since certain changes may be made without 
departing from the scope of the present invention, it is intended that all matter 
5 contained in the above description or shown in the accompanying drawings be 

interpreted as illustrative and not in a literal sense. Practitioners of the art will realize 
that the separate requests and responses illustrated herein may have fields added or 
deleted from the request or response and additional requests and responses may be 
added from one protocol version to the next without departing from the scope of the 
1 0 present invention. 
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We Claim: 

1 . In a remote control device having a network interface with a network, 
5 said network having additional devices interfaced with the network, 

a method, comprising the steps of: 

providing a protocol to enable said remote control device to dynamically 
locate, and identify a network attached device, and 

with the protocol, retrieving dynamically the command codes of said network 
10 attached device, and 

with the protocol, controlling the operations of said network attached device 
by means of said dynamically retrieved command codes. 

2. The method of claim 1 wherein said method further comprises the steps of: 

1 5 with the protocol, sending communications over an Internet Protocol (IP) 

based network. 

3. The method of claim 1 wherein said method further comprises the steps of: 

with the protocol, dynamically locating and identifying multiple network 
20 attached devices with the remote control device 

4. The method of claim 1 wherein said method further comprises the steps of: 

with the protocol, controlling the operations of multiple network attached 
devices with the remote control device 

25 

5. The method of claim 1 wherein said method further comprises the steps of: 

with the protocol, said remote control requesting and receiving a list of 
command codes from a network attached device. 

30 6. The method of claim 5 wherein said method further comprises the steps of: 

with the protocol, sending received command codes to said network attached 
device from the remote control device. 
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7. The method of claim 1 wherein said method further comprises the steps of: 

with the protocol, displaying on the display surface of said remote control a 
list of the network attached devices available to a user. 

5 

8. The method of claim 1 wherein said method further comprises the steps of: 

with the protocol, selecting a device to control from among those listed on the 
display surface of the remote control device by a user of the remote control device. 

10 9. The method of claim 1 wherein said method further comprises the steps of: 

with the protocol, said network attached device receiving a request for its 

command codes from said remote control device, and 

with the protocol, said network attached device providing said command 

codes to the remote control device. 

15 

10. The method of claim 1 wherein said method further comprises the steps of: 

with the protocol, said network attached device providing its command codes 
and an associated text string for each code to the remote control device in response to 
a request from the remote control device. 

20 

1 1 . The method of claim 1 wherein said method further comprises the steps of: 

with the protocol, said network attached device providing its command codes 
and an associated graphical image for each command code to the remote control 
device in response to a request from the remote control device. 

25 

12. The method of claim 1 wherein said method further comprises the steps of: 

with the protocol, said network attached device providing its command codes 
and an associated graphical image and text string for each command code, to the 
remote control device, in response to a request from the remote control device. 

30 

13. The method of claim 1 wherein said method further comprises the steps of: 

with the protocol, said network attached device receiving and executing one of 
its command codes from said remote control device. 
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14. In a remote control device having a network interface with a network, said 
network having additional devices interfaced with the network, said network being 
located within a motor vehicle, a method, comprising the steps of: 

5 providing a protocol to enable a network attached device to be 

dynamically located, and identified by the electronic remote control device, and 

with the protocol, said remote control device controlling the operations of said 
network attached device by means of command codes dynamically retrieved from the 
network attached device. 

10 

15. The method of claim 14 wherein said method further comprises the steps of: 

with the protocol, sending communications over an Internet Protocol (IP) 
based network. 

15 16. The method of claim 14 wherein 

said remote control device contains a touch pad screen. 

17. A medium for use with a remote control device with a network interface with a 
network, said medium holding computer-executable instructions for performing a 

20 method comprising: 

providing additional network attached devices, and 
providing a protocol to enable a network attached device to be 
dynamically located, and identified by the electronic remote control device, and 

with the protocol, said remote control device controlling the operations of said 
25 network attached device by means of command codes dynamically retrieved from the 
network attached device. 

1 8. The medium of claim 17 wherein said method further comprises the steps of: 

with the protocol, sending communications over an Internet Protocol (IP) 
30 based network. 

19. The medium of claim 17 wherein 

said network is located in a motor vehicle. 
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20. The medium of claim 17 wherein 

said remote control device includes a touch pad display screen. 
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ABSTRACT 

The present invention addresses the difficulties of controlling new devices 
5 which have been added to a network. A network protocol, the NetCTL protocol, 

enables a remote control device to dynamically learn the command codes of a newly 
network attached device if the new device is executing the protocol. The intervention 
of a system administrator is not necessary since the dynamic learning process happens 
automatically when the new device is attached to the network. Because the protocol 

10 allows the remote control device to learn the codes dynamically, there is no need to 
consult previously written tables of commands which can omit the codes for newly 
invented devices. A user of the remote control device which has "learned" the codes 
( i.e. acquired the codes ) for a network attached device is able to control that device, 
regardless of the device's physical location, by selecting and sending the network 

1 5 attached device a command code to perform an operation. 
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Send Correspondence to Kevin J. Canning, Esq. at Customer Number: 000959 whose address 
is: 

Lahive & Cockfield, LLP, 28 State Street, Boston, MA 02109 



Direct Telephone Calls to: (name and telephone number) 
Kevin J. Canning, Esq., (617) 227-7400 



Wherefore I petition that letters patent be granted to me for the invention or discovery described and 
claimed in the attached specification and claims, and hereby subscribe my name to said specification 
and claims and to the foregoing declaration, power of attorney, and this petition. 

I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the like so made are punishable by 
fine or imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that 
such willful false statements may jeopardize the validity of the application or any patent issued 
thereon. 
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